Web Survey Bibliography
Many companies are faced with the question whether administering surveys to their employees via Internet technologies will lead to different results than surveying them with paper and pencil, just because of the technologies or the psychological aspects of using the technologies. In a 2x2x2x2 factorial (quasi-)experimental design it was investigated whether anonymity, voluntariness, age, and administration mode (Internet versus paper-and-pencil) would influence answering behavior in a newly designed short-format employee survey. Employees in one complete section of a large Swiss company (N=655) were randomly assigned to conditions and invited to participate in the survey. Overall, 318 employees responded, with lower return rates for anonymous and for voluntary conditions: anonymous & voluntary 31% return vs. less anonymous & less voluntary 58% return, with other conditions in-between. There was also a tendency for differences in dropout. Voluntariness had a significant effect on response times, a dependent measure that could be applied in the Internet condition only. Age and anonymity were shown to have significant influence on the expression of job satisfaction; voluntariness and administration mode showed tendencies to moderate these influences. Effects of anonymity were shown to be stronger for participants who chose to reveal even less information about themselves by leaving questions with identifying content unanswered. Results will be discussed in terms of the strategic aspect of the Social Identity model of Deindividuation Effects (SIDE). Methods and applications used in developing and administering the employee survey and in analyzing the data will be presented. Recommendations will be made regarding the increase of response rates, the avoidance of social desirability in survey answering behavior, and the organization of Internet-based employee surveys.
Das Internet kann für Mitarbeiterbefragungen eingesetzt werden, aber in vielen Unternehmen stellt sich die Frage, ob sein Einsatz einfach aufgrund dieser neuen Technologie oder der psychologischen Aspekte im Umgang mit der Technologie zu anderen Ergebnissen führen kann. In einem 2x2x2x2 faktoriellen (quasi-)experimentellen Design wurde untersucht, ob Anonymität, Freiwilligkeit, Alter, und Befragungsmodus (Internet-gestützt versus Papier-und-Bleistift) das Antwortverhalten in einer neu entwickelten kurzformatigen Mitarbeiterbefragung beeinflussen würde. Alle Mitarbeiter einer Arbeitseinheit (N=655) eines grossen Schweizer Unternehmens wurden zufällig den Versuchsbedingungen zugeteilt und zur Teilnahme an der Befragung eingeladen. Im Ganzen antworteten 318 Beschäftigte, es zeigten sich geringere Response-Raten in den anonymen und freiwilligen Bedingungen: anonym & freiwillig 31% Response vs. wenig anonym & eingeschränkt freiwillig 58% Response, die anderen Versuchsbedingungen lagen dazwischen. Es zeigte sich auch eine Tendenz zu unterschiedlichem Teilnahmeabbruch. Freiwilligkeit hatte einen signifikanten Effekt auf die Antwortzeiten, einem abhängigen Mass, das nur in der Internet-Bedingung erhoben werden konnte. Die Befragungsergebnisse zeigen Effekte von Anonymität und Alter auf Arbeitszufriedenheitsäusserungen, die tendenziell durch Freiwilligkeit und Befragungsmodus moderiert wurden. Einflüsse der Anonymität erwiesen sich stärker bei Teilnehmern, die noch weniger Informationen über sich preisgaben, idem sie Fragen mit identifizierendem Inhalt unbeantwortet liessen. Diese Ergebnisse werden im Hinblick auf das Social Identity model of Deindividuation Effects (SIDE) diskutiert. Methoden und Anwendungen, die in der Entwicklung und Durchführung der Mitarbeiterbefragung und bei der Datenanalyse benutzt wurden, werden vorgestellt. Es werden Empfehlungen zur Erhöhung der Response-Raten, der Vermeidung von sozial erwünschtem Antwortverhalten und zur Durchführung von Internet-basierten Mitarbeiterbefragungen gemacht.
Homepage - conference (abstract)
Web survey bibliography - Other (439)
- Perceptions of News Credibility about the War in Iraq: Why War Opponents Perceived the Internet as the...; 2006; Choi, J. H., Watt, J. H., Lynch, M.
- The Internet and Anti-War Activism: A Case Study of Information, Expression, and Action; 2006; Nah, S., Veenstra, A. S., Shah, D. V.
- An investigation of the effect of lotteries on web survey response rates; 2006; Heerwegh, D.
- The ethics of research using electronic mail discussion groups; 2005; Kralik, D., Warren, J., Koch, T., Pignone, G., Price, K.
- The Analyses of Domestic Study about Internet Survey; 2005; Rui, L., Tie-ying, S.
- The Effect Of A Simultaneous Mixed-Mode (Mail And Web) Survey On Respondent Characteristics And Survey...; 2005; Brennan, M.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Exploring users' attitudes and intentions toward the web as a survey tool; 2005; Huang, H.-M., Liaw, S. S.
- Response and Field Period Effects: The Effect of Time in Online Market Research and Consequences for...; 2004; Basso Larsen, R., Rathod, S.
- Design and Application of On-line Questionnaries: Experiences from Micronesia; 2004; O'Neill, J. G., Spennemann, D. H. R.
- Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research; 2004; Reips, U.-D., Stieger, S.
- Identifying and Reducing Response Burdens in Internet Business Surveys; 2004; Haraldsen, G.
- Developing automated e-survey and control tools: an application in industrial management; 2004; Scornavacca Jr., E., Becker, J. L., Barnes, S.
- Using progress indicators in web surveys; 2004; Heerwegh, D.
- Employee surveys via Internet or paper? The influence of administration mode, anonymity, voluntariness...; 2004; Reips, U.-D., Franek, L.
- Experiences in e-survey development for IS research: Lessons from the use of automated control tools; 2003; Scornavacca Jr., E., Becker, J. L., Barnes, S.
- Impact of messages on concomitant use of nicotine replacement therapy and cigarettes: a randomized trial...; 2003; le Houezec, J., Landfeldt, B., Etter, J.-F.
- The feasibility of computer-assisted survey interviewing in Africa: Experience from two rural districts...; 2003; Hewett, P. C., Erulkar, A. S., Mensch, B. S.
- Identifying key factors affecting consumer purchase behavior in an online shopping context; 2003; Park, C.-H., Kim, Y.-G.
- On-line qualitative market research: Interviewing the world at a fingertip; 2002; Scholl, N., Mulders, S., Drent, R.
- Group decision making in a multiple criteria environment: A case using the AHP in software selection; 2002; Lai, V.S., Wong, B.K., Cheung, W.
- WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures; 2002; Reips, U.-D., Neuhaus, C.
- Drawing a few from many; 2002; Fitzgerald, A.
- The Kid's Experimental Psychology Lab: A Web Site for Internet Research with Children; 2002; Frick, A., Reips, U.-D.
- Work-life balance among Croatian employees: role time commitment, work-home interference and well-being...; 2002; Sverko, B. B., Araasic, L., Galesic, M.
- Electronic data collection in Statistic Norway; 2002; Sæbø, H. V., Gloersen, R., Sve, D.
- Web Surveys: The Effect of Controlling Survey Access using PIN Numbers; 2002; Heerwegh, D., Loosveldt, G.
- Going Global: Issues in Applying Internet; 2001; Bauman, S., Jobity, N., Wilson, D., Atak, H., Deis, M., Airey, J.
- Affective dimensions of Internet culture; 2001; King, A. B.
- Measuring the Flow Construct in Online Environments: A Structural Modeling Approach; 1999; Novak, T. P., Hoffman, D. L., Yung, Y.-F.
- Realtime Interviewing Using the World Wide Web; 1999; Chen, Pe., Hilton, S. M.
- Comparing Seven Forms of Online Surveying; 1999; MacElroy, B.
- Ethical decision making in business: A comparison between New Zealand decision makers and a World Wide...; 1999; Frey, B. F.
- A case study of an on-line auction for the World Wide Web; 1998; Tjostheim, I., Eide, J.-O.
- The top 10 FAQs about on-line research; 1998; MacElroy, B.
- Response-Order Effects in Likert-Type Scales; 1991; Chan, J. C.